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a ■ Sy J lC ?L I dls P ,av $ text and graphic information with broadcasted television images includes a VBI inserter (16) for inserting 
data into the \ BI of a publicly broadcasted video signal. An associated personal computer (10) includes a VBI decoder for separating the 
data from the video signal. The separated data contains command and address information which instruct the PC to retrieve text/graphic 
information from a storage device, and display the information on a monitor (30). The broadcaster inserts data that retrieves text and 
graphic information which correspond to the television image displayed by the monitor. The retrieved text and graphic data mav be stored 
for later viewing by the user. 
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ROM DATA TRANSMITTED IN THE VBI TO A PERSONAL COMPUTER THROUGH 
TELEVISION BROACAST CHANNELS 


BACKGROUND OF THE INVENTION 

1 • _ FIELD OF THE INVENTION 

The present invent icr. relates to a method and 
apparatus for inserting database address information 
into the vertical blanking interval of a video signal 
that is received by a personal computer . 

2 . DESCRIPTION OF RELATED ART 

Some computer systems contain MTSC decoders which 
allow publicly broadcasted video to be displayed cn the 
mcnitor of the computer. The video may be displayed in 
a separate window that allows the user to view the video 
images while performing other operations cn the system. 

Personal computers can also he provided with text 
oriented databases' that can be retrieved and viewed bv 
the user. By "way of example, there is a program 
marketed under the trademark INTERACTIVE ENCYCLOPEDIA by 
COMPTON of San Diego, California which provides an 
interactive encyclopedia. The COMPTON product allows 
the user to select and review text and graphics which 
correspond to various historical events, geographical 
locations, etc. . .. 

It would be desirable to provide a system that 
would retrieve and display text/graphic data which 
corresponds to a television image displayed on a 
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computer monitor. For example, if a user is watching an 
informational program, on elephants, it would be 
desirable if various facts and graphics on elephants 
were presented on the screen along with the television 
image. It would also be desirable if the' relevant 
facts/graphics were stored in memory for later viewing 
by the user . ' 

SUMMARY OF THE INVENTION 

The present invention is a system that displays 
text and graphic information with broadcasted television 
video. The broadcast system includes a vertical ^ 
blanking interval ( V5I ;• inserter which inserts data into 
the vertical blanking interval of a broadcasted video 
signal. The receiving system includes a personal 
computer that contains a V5I decoder which cap. separate 
the data from the video signal. The separatee* data 
contains command and address information, which instruct 
the personal computer .to retrieve text / graphic 
information from a storage device, and disci ay the 
retrieved text /graphic information on a monitor. The 
personal computer also contains a NTSC decoder which car- 
decode the video signal and display a television image 
on the monitor. The broadcaster inserts data that 
retrieves text and graphic information which correspond 
to the television image displayed by the monitor. The 
retrieved text and graphic information may be stored for 
later viewing by the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and advantages of the present invention 
will become more readily apparent to those ordinarily 
skilled in the art after reviewing the following 
detailed description and accompanying drawings, wherein: 
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Figure 1 is a schematic of the system of the 
present invention; 

Figure 2 is a screen of a video* monitor; 

Figure 3 is a schematic showing the layers of a 
video encoder; 

Figure 4 is a schematic showing the formatting of a 
video frame that is inserted into the video blanking 
interval of a video signal; . 

Figure 5 is a schematic showing the formatting cf a 
video packet; 

Figure 6 is a schematic shewing the formatting of a 
message provided to the encoder. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring to the drawings more particularly by 
•reference numbers, Figure 1 shews a system of the 
present invention. The system includes a personal 
computer 10 that receives video signals and other 
information fror; a broadcaster 12. The broadcaster 12 
may be any broadcasting system including satellite and 
cable networks. The broadcaster 12 includes a vertical 
blanking interval {VEI- inserter 16 that has one input 
connected to a video source IS and another input 
connected to a data source 20. The video source IS 
generates video 5 signals that have a vertical blanking 
interval. The V3I inserter 16 inserts data generated by 
source 2C into the vertical blanking interval of the 
video signal. The VEI inserter 16 can be a unit sold by 
Norpak Corp. of Ottawa, Ontario, Canada under model 
number TDS-3. The video signal and accompanying 
inserted data are transmitted by ' a transmitter 22. 

The video signal and inserted data are received by 
a receiver 24. ' The receiver 24 provides the signal and 
data to a vertical blanking interval (VEI) decoder 26. 
The VEI decoder 26 which separates the data from the 
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video signal. The video signal is provided to a NTSC 
decoder 28. The decoder 28 converts the video signal 
into television signals that can be displayed on a 
computer monitor 30. 

The computer 10 typically contains a central 
processing unit {CPU) 32, a dynamic random access memory 
(DRAM) device 34, a massive storage device such as a 
hard disk drive 36 , and an optical disk drive 36. The 
optical disk drive 38 may contain an optical disk which 
contains a text and graphic based database.. By • way of 
example, the optical disk may be a "CD-ROM" product sold 
by CCMPTON software under the trademark INTERACTIVE 
ENCYCLOPEDIA . Tne COMPTON ENCYCLOPEDIA contains text 
and -graphic information which relate to historical 
events, geographical locations, etc, typically found. in 
an encyclopedia. The text and graphic in format ion is 
located within addressable memory locations o:: the 
optical disk. 

The CPU 3 2 receives the data separated f ::ox the 
video signal by the YE I decoder 26. The data typically 
contains command and address information that instruct 
the CPU 3 2 tc retrieve specific text and graphic 
information from the optical disk ? S and display the 
information on the computer monitor 30. 

Figure 2 shows a screen of the computer monitor 30. 
The screen may include a window 4 0 that displays the 
television image and a separate window 42 that; shows the 
text and graphic information retrieved from the optical 
disk 38. The text /graphic information typically relates 
tc the video image shown in window 40. For example, the 
video window 40 may display an elephant. The • 
text/graphic window 42 may display particular facts 
regarding elephants. The monitor 30 may have a 
graphical user interface for input commands 44 that 
allows the user to change television channels. The new 
channel may also contain VBI inserted data vh:.ch 
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retrieves and displays text/graphic information that 
relates to the television images shown on th.e new 
channel . ■ - 

The personal computer may have a resident program 
which stores the text/graphic information retrieved from 
the optical disk 38 onto the magnetic disk drive 36. 
Additionally, the program may have a configuration 
window which allows the user to select whether the 
text /graphic information is to be saved. The 
text /graphic information may be saved in a file that can 
be recalled and viewed by the user. The video signal 
may be converted to a binary format for storage with the 
text ,■ graphic information so that the user can view^the 
text and video in combination. Alternatively, the .rvideo 
signal may be stored on a video cassette recorder (not 
shown) . 

As shown in Figure 3, the format of the inserter 16 
may have different application layers, including a 
transport layer 50, a network layer 52 and a dataimk 
layer 54 which convert the program data from the data 
source into a serial data stream that can be inserted 
into the vertical blanking interval of the video signal 
by the VEI inserter 16 . The transport layer 50 provide? 
an interface with the data source. The data source 20 
may be a personal computer which is programmed to send 
commands, addresses etc, at predetermined time 
intervals. For example, the video signal may be 
transmitting images of an elephant between 0-5 minutes 
and a tiger between 5-10 minutes. The data source 20 
can generate command/ address data to retrieve "elephant" 
text /graphic data at 0 minutes and then generate 
command/address . data to retrieve "tiger" text /graphic 
data at 5 minutes, and so forth and so on. 

The network layer 52 packetizes the data. The 
datalink layer 54 serializes the packeted data for 
serial transmission to the V3I inserter 16. In the 
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preferred embodiment, the associated data is provided to 
the VBI inserter in a Vt__Frame 60 shown in. Figure 4. 
The Vt_Frame 60 includes a start frame field STX 62, a 
data packet field Vt_Packet 64, a check field CRC 66 and 
an end of frame character ETX 68. 

In the preferred embodiment, the Vt_Facke-t 64 is 
formatted as shown in Figure 5. The nPacket Pr ctocal 
field 70 is a byte-length field which identifies the 
packet as one supported by the protocol. The nVersion 
field 72 specifies the type of inserter that is 
transmitting the packet. The nChanID field 74 is an 
integer value which provides the channel number of the 
packet in the serialized bitstream. The nMessagelD 
field 76 specifies the message number of the channel on 
which the packet is transmitted. The nPacketID field 78 
defines the number of packets in a particular message. 
The fHorePacke: s field 80 specifies whether there are 
any more packets in the message. The f Reserved field 82 
is reserved fcr further use. The length of the data is 
specified in the nDataSize field 84. The nData field 86 
contains the data. 

In the preferred embodiment , the data is typically 
provided tc the inserter 16 by the data source- in the 
format shown in Figure 6. The nMessageProtocal field 5 r 
is a byte length field which identifies the type of 
transmission being provided. The nVersion fierld 90 
identifies the version of the protocol. The ilsHint 
field 92 indicates that the data is to precede; an event 
such as a television program. The flsUPdate field 94 
indicates whether the information is updating 
transmitted information. The f Reserved field 96 is 
unused and reserved fcr later use. The field nDataSize 
98 specifies the number of bytes in the data field. The 
nOpcode field 100 define a particular operation to be 
performed with the data. Fcr example, the operation may 
be a read memory command and a display command. The 
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fReserved2 field 102 is net used and the bData field 104 
contains the data. The data may contain the specific 
addresses to be retrieved from the storage device 38. 
The addresses requested typically correspond to the 
physical address locations of the desired data on the 
optical disk. Alternatively, a common address may be 
employed with a specific optical disk identification 
(ID). The broadcaster may transmit the specific optical 
disk ID and the address data. The computer may have a 
look-up table which allows the CPU to map the requested 
address information to the physical addresses of the 
requested optical disk. 

In operation, the data source 20 provides program 
data that is inserted into the vertical blanking 
interval of a video signal by the VBI inserter 16. The 
video signal and data are transmitted to the VBI decoder 
2 5 which separates the data from the video signal. The 
video signal is converted to a television image that is 
displayed by a computer mor.itcr 30. The separated data 
is provided tc the CPU 32 -which generates commands that 
retrieve data from the optical disk 38 in accordance 
with address information provided with the data. The 
retrieved data is displayed with the television image en 
the monit or 3 C . The CPU 32 can also command a storage 
of the retrieved data from the optical disk 3 S to the 
magnetic disk 36 for later retrieval. 

While certain exemplary embodiments have been 
described and shown in the accompanying drawings, it is 
to be understood that such embodiments are merely 
illustrative of and not restrictive on the broad 
invention, and that this invention not be limited tc the 
specific constructions, and arrangements showTi and 
described, since various other modifications may occur 
to those ordinarily skilled in the art. 
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What is claimed is: 

1. A system that receives a videc signai and a 
data signal from a broadcaster which inserts the data 
signal into a vertical blanking interval of the video 
signal, comprising: 

a video receiver that receives the video and data 
signals; 

a vertical blanking interval decoder tha: separates 
the data signal from the video signal; 

a video decoder that converts the video .signal into 
a television signal ; 

a monitor that displays the television signal; 
•' a storage device that contains a text / graphic 
signal ; and , 

a data retrieval circuit which receives :he data 
signal from said vertical blanking interval decoder and 
provides a corresponding t ex: /graphic signai to said 
monitor . 

2. The system as recited in claim 1 , wherein said 
storage device is an optical disk drive. 

3. The system as recited in claim 1, wherein the 
data signal includes a memory address. 

4. The system as recited in claim i, wherein said 
data retrieval circuit commands a storage of :said 
text/graphic signal into a file of said storage device. 

5. A system, comprising: 

a broadcaster that transmits a video signal and a 
data signal that is inserted into a vertical clanking 

r ■ 

interval of the video signal; 

a video receiver that receives the video and data 
signals; 
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a vertical blanking interval decoder that separates 
the data signal from the video signal; 

a video decoder that converts the video signal into 
a television signal; 

a monitor that displays the television signal; 

a storage device that ' contains a text /graphic 
signal; and, 

a data retrieval circuit which receives the data 
signal from said vertical blanking interval decoder and 
provides a corresponding text/graphic signal to said 
men i tor . 

6. The system as recited in claim 5, wherein said 
storage device is ar. optical disk drive. 

7. The system as recited in claim 5, wherein the 
data signal includes a memory address. 

S. The system as recited in claim 5, wherein said 
data retrieval circuit commands a storage cf said 
text /graphic signal into a file of said storage device. 

9. A broadcasting system, comprising: 

a broadcaster that 'generates a video signal that 
has a vertical blanking interval; 

a vertical blanking interval encoder which inserts 
a data signal containing a memory address into the 
vertical blanking interval of the % p ideo signal; and, 

a transmitter that transmits the video and data 
signals . 

10. A method for displaying video and 
corresponding text on a computer monitor- from a 
transmitted video signal which has a data signal 
inserted into a vertical blanking interval of the video 
signal, comprising the steps of:' 
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a) receiving the video and data signals; 

b) separating the data signal from the video 
signal;" 

c) converting the video signal into a television 
signal ; 

d) displaying the television signal on a monitor 

e) retrieving a text /graphic signal from a 
storage device in response to the separated data signal, 
and, 

f) displaying the text /graphic signal on said 
monitor. 

11. The method as recited in claim 10, ::urt her 
comprising the step of storing the text /graphic signal- 
in a file. 

12. A method for displaying video and 
corresponding text on a computer monitor, comprising t hi 
steps of : 

a) inserting a data signal into a vertical 
blanking interval of a video signal; 

b; transmitting the video and data signals; 

c) receiving the video and data signals; 

d) separating the data signal from the video 
signal; 

e) converting the video signal into a television 
signal ; 

f) displaying the television signal on a monitor 

g) retrieving a text/graphic signals from a 
storage medium in response to the separated data signal; 
and, 

h) displaying the text/graphic signal on said 
monitor. 
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13. The method as recited in claim 12, further 
comprising the step of storing the text/graphic signals 
in a file. 

14. A method for broadcasting video signals, 
comprising the steps of: 

a) generating a video signal which has a vertical 
blanking interval; 

b) inserting a data signal containing a memory 
address into the vertical blanking interval; and, 

c) transmitting the video and data signals. 

15. A sysrex that receives a video signal and a 
data- signal from a broadcaster, which inserts the data 
signal into a vertical blanking interval of the video 
signal, comprising: 

video receiver means for receiving the video and 
data signals; 

vertical blanking interval decoder means for 
separating the data signal from the video signal; 

video decoder means for converting the video signal 
into a television signal; 

monitor -ear.? for displaying said television 
signal; 

storage means for storing a text /graphic signal; 

and, 

data retrieval circuit means for receiving the data 
signal from said vertical blanking interval decoder 
means and providing a corresponding text /graphic signal 
to said monitor means. 

16. The system as recited in claim 15, wherein 
said storage means is an optical disk drive. 

17. The system as recited in claim 15, wherein the 
data signal includes a memory address. 
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18. The system as recited in claim 15, wherein 
said data retrieval circuit means commands a storage of 
said text/graphic into a file of said storage means. 

19. A system, comprising: 

broadcaster means for transmitting a video signal 
and a data signal that is inserted into a vertical 
blanking interval of the video signal; 

video receiver means for receiving the video and 
data signals; 

vertical blanking interval decoder means for 
separating the data signal from the video signal ; 

* video decoder means for converting the video signal 
into a television signal; 

monitor means for displaying the television signal; 

storage means for storing a text/graphic signal; 

and , 

data retrieval circuit means for receiving the data 
signal from said vertical blanking interval decoder 
means and providing a corresponding text . graphic signal 
to said monitor means. 

20. The system as recited m claim 19, wherein 
said storage means is an optical disk drive. 

21. The system as recited in claim 21, wherein the 
data signal includes a memory address. 

22. The system as recited in claim 21, wherein the 
data retrieval circuit means commands a storage of said 
text/graphic into a file of- said storage means; . 

22. A broadcasting system, comprising: 
broadcaster means for generating a video signal 
that has a vertical blanking interval; 
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vertical- blanking interval encoder means fcr 
inserting a data signal containing a memory address into 
the vertical blanking interval of the video signal;' and, 

transmitter means fcr transmitting the video and 
data signals . 


WO 97/18669 


PCT/US96/17929 



WO 97/18669 


2/3 


PCT/US96/17929 



SUBSTITUTE SHEET (RULE 26) 


WO 97/18669 


PCT/US96/17929 


J/J 


5 

I 


<N 

vo vo 

V . V . N 


Co 


s 


to 

I 


3 


I 


I 

Co 


1 


i 

CO 


1 


i 


1 


1 


5 


Ft 
to 

I 

5 


5 


5 


to 


5 


to 

1 


to 


1 

CO 

a 


I 

<o 

1 


^ > > > > > > > > 


to 


s 

a 

1 

t^5 


c: 


5 


fei 

1 

<-0 


9= 


N 
to 


i 


9= 


5 


C\| > On 

rx! k: k: 


g£ \ \ \ \ \ V V V V 


5 c\ > to 
°Q QO Qo Co 


<0 


1 

I 

I 


to 


CO 

,<o 


8 


9c 


to 


5 


CD 


,1 


[\ > do 

<o <o <o vo 


CO 


1 


















CO 













SUBSTITUTE SHEET (RULE 26) 


INTERNATIONAL SEARCH REPORT 


true. tonal application No. 
PCT/US9eVl7929 


A. CLASSIFICATION OF SUBJECT MATTER 
1PC(6) ;H04N 5/445. 7/087 

US CL :343/468. 460 

According U> International Pa tent Classification (IPC) or lo both nation*] classification and IPC 

B. FIELDS SEARCHED 

Minimum documentation searched (classification system foUowcd by classification symbols) 

U.S. : 34S/468, 460. 553. 564, 13. 478 

Documentation searched other than minimum documentation to the extent that such documents arc included in the Heidi searched 


Electron*- data baae consulted during the international search (name of data base and. where practicable, search terms used) 


DOCUMENTS CONSIDERED TO BE RELEVANT 


Category" 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


US, A # 4,894,789 (YEE) 1 6 January 1 990, whole document. 

US, A, 5,262,860 (FIT2PATRICK ET AL) 16 November 
1 993, col. 2, lines 5-37. 


1-23 
1-23 


I Further documents are listed in the continuation of Box C. | | See patent family annex. 


Special caicf orioa of cited document*: 

docutBaudcfioinf tbc general atate of (be an » tuch m oot coc*«Jcrad 
lo be part of particular relevance 

earlier document pvtbLUhed on or after the interaaiiooaJ HUof dale 

document wtucb may throw doubu oo priority claim* •) or which m 
cued lo ex abbah Che publication date of another citation or other 
kpeciaj reaaoa (m apeci/»©d) 


later document publuhed after (be tnlcrnaoooaj filing dale or 
dale and oot m vonlbct «iih the appbeauoo but cited to 
principle or theory urh'erlyiof (he tovcouoo 


priority 


document of parucular reloi 
coo* id c red novel or cannot be 
when the document » uki 


document referring to an oral dtacloaurc. uae, echibitioo or other 

do c um e nt pubuabed poor to tbc mtcrnatioojaj filing dale but later than 
the priority date claimed 


e; the claimed ■tvcoUoo 
nadered lo involve an av 


Dvmlioo < 
b doc 


document of parucuUr relevance: the claimed 
coo* id c red to involve .an mvent/ve atep wb« 
combined with one or more other cucb documcn 
being obvioua lo a pcraoa aLilied m the art 

document member of the aamc patent family 


Date of the actual completion of the international search 
13 DECEMBER 1996 

Date of mailing of the international search report 

3 1 JAW w 

Name and mailing address of the ISA/US 
Commistioner of P*irnu and Traderrurks 
Box PCT 

Wtihinpon. D.C. 20231 
Facsimile No. (103) 305-3230 

Authorized officer 

" . 1 « BRIAN A. HARDEN 
victor R. kostak • . PARALEGAL SPECIALIST 

Telephone No. (703) 305-4374 GROUP 2^00 


Form PCT/ISA/210 (second sheet)(Ju]y 1992)* 


